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^= (54) Title: METHOD AND DEVICE FOR BROWSING INFORMATION ON A DISPLAY 




(57) Abstract: The idea of the 
present invention is to browse 
information on a display device 
of a hand-held device naturally 
and logically. Characteristic of 
the invention is that information 
is browsed on the display device 
essentially in a mirror-like way. 
In other words, the portion of the 
virtual data object displayed on 
the display device is moved in the 
same direction as the hand-held 
device is tilted. In other words, 
the movements of the portion of 
the virtual data object displayed on 
the display device depends on the 
orientation of the hand-held device. 
An important feature of the invention 
is also that a certain orientation of 
the hand-held device always displays 
the same portion of the virtual data 



object on the display device. The 
browsing method described above is extremely logical, and the movements and responses to the movements are natural. 
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image fluently and to return from some point to the 
initial point of browsing is difficult because con- 
trolling a discontinuous motion requires continuous 
and precise handling of the display device. The con- 
5 trolling of the scrolling movement can be compared to 
a movement of a ball on a plane surface by tilting the 
plane. In order to stop the rolling of the ball, the 
plane surface must be perpendicular against the grav- 
ity of the earth. In other words, the control of the 
10 movements and usability are not at an acceptable level 
so that the use of such a device would be natural and 
logical. 

There are also various kinds of motion and/or 
location controlled display devices used in, e.g. in 

15 virtual helmets. There the display device focuses like 
a virtual camera. The display device displays an ob- 
ject to which the device (camera) points in the mod- 
elled virtual environment. To use a virtual camera 
model in a hand-held device is not so straightforward 

20 because displaying peripheries of a large screen image 
results in a disadvantageous viewing angle. Therefore, 
the adjustment and zooming of a display image must be 
implemented in a most natural and logical manner. In 
prior-art solutions the browsing of information on the 

25 display device is slow and awkward because the solu- 
tions are based on artificial logic. 

THE PURPOSE OF THE INVENTION 

The goal of the present invention is to ad- 
30 just the view on the display device in a manner as 
natural as possible so that the user of the hand-held 
device can concentrate on the information displayed on 
the display device and not on the adjustment of the 
displayed information. 

35 
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SUMMARY OF THE INVENTION 

The present invention describes a method, 
hand-held device and computer program for browsing in- 
5 formation on a display device of a hand-held device. 
In the present invention, the display device is cou- 
pled to a processor mapping the information content 
generated by the processor into the virtual data ob- 
ject suitable for conveying the information to the 

10 user of the hand-held device. The display device dis- 
plays a portion of the virtual data object at a time 
on the display device. The virtual data obj-ect com- 
prises e.g. characters, pictures, lines, links, video 
or pixels that can be conveniently displayed on the 

15 display device at a time. 

The idea of the present invention is to 
browse information on the display device of a hand- 
held device naturally and logically. Characteristic of 
the invention is that information is browsed on the 

20 display device essentially in a mirror-like way. In 
other words, the portion of the virtual data object 
displayed on the display device is moved at the same 
direction as the hand-held device is tilted. In other 
words , the movements of the portion of the virtual 

25 data object displayed on the display device depends on 
the orientation of the hand-held device. An important 
feature of the invention is also that a certain orien- 
tation of the hand-held device always displays the 
same portion of the virtual data object on the display 

30 device. The browsing method described above is ex- 
tremely logical, and the movements and responses to 
the movements are natural . 

The core functions of the browsing can be ex- 
plained by means of the following example. The infor- 

35 mation is browsed with the hand-held device essen- 
tially in the same way as looking at a view from a 
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hand mirror. The hand mirror is typically held in hand 
quite close to the viewer. The hand mirror represents 
the display device and the view behind the viewer the 
virtual data object. When the hand mirror is tilted, 
5 the view behind the viewer moves in response to the 
changes in the orientation of the hand mirror. 

When approaching the f unctionality of a hand 
mirror the browsing of information on a display device 
of a hand-held device is made natural and logical. 

10 The present invention is most applicable with 

hand-held devices with a display when a large data ob- 
ject is displayed by parts on the display. With the 
present invention, a large data object can be browsed 
naturally and logically from the user's perspective. 

15 The position memory of the muscles of a human body 
makes it easier to return to previously browsed points 
and to the starting point. 

The present invention also reduces the need 
to use exterior mechanical switches, keypad or other 

20 known control mechanisms for browsing information on 
the display device. Therefore the use of a hand-held 
device is easier and more simple. The basic function- 
alities of the present invention can be implemented 
with mass production components, and with moderate 

25 processing power. Thus, the features described in the 
present invention can be taken in use in consumer 
products without notable expense increase. 

BRIEF DESCRIPTION OF THE DRAWINGS 

30 The accompanying drawings, which are included 

to provide a further understanding of the invention 
and constitute a part of this specification, illus- 
trate embodiments of the invention and together with 
the description help to explain the principles of the 

35 invention. In the drawings: 
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Fig 1 illustrates how the hand-held device is 
operated according to the present invention, 

Figs 2a, 2b and 2c illustrate more specific 
examples of how the hand-held device of Figure 1 is 
5 handled, 

Fig 3 illustrates an exemplary viewing setup 
of the present invention, 

Fig 4 illustrates an example of how a view on 
the display device can be formed and calculated ac- 
10 cording to the viewing setup of Figure 3, 

Fig 5 is a block diagram illustrating an em- 
bodiment of the hand-held device in accordance with 
the present invention, 

Fig 6 is a block diagram illustrating another 
15 embodiment of the hand-held device in accordance with 
the present invention, 

Figs 7a, 7b, 7c and 7d illustrate the view 
change of the display of the hand-held device in re- 
sponse to user actions, 
20 Figs 8a, 8b and 8c illustrate different ways 

of browsing information, and 

Fig 9 is a flow diagram illustrating the op- 
eration of a preferred embodiment of the present in- 
vention. 

25 

DETAILED DESCRIPTION OF THE INVENTION 

Figure 1 illustrates a simplified portable 
hand-held device according to the present invention. 
The hand-held device is e.g. a mobile phone or a Per- 

30 sonal Digital Assistant (PDA) . The display device of 
the hand-held device displays information stored on a 
memory of the hand-held device. The hand-held device 
is explained more specifically in later examples. Fig- 
ure 1 represents the basic browsing functionality. In- 

35 formation is browsed on the display device by tilting 
(rotating) the hand-held device 4 0 towards directions 
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2,3,4 and 5 around the axis 6 and 7. The memory of the 
hand-held device 40 comprises a virtual data object 
comprising characters, pictures, lines, links, video 
or pixels that can be conveniently displayed on the 
5 display device at a time. A portion of the virtual 
data object displayed on the display device is moved 
at the same direction as the hand-held device is 
tilted. Moreover, a certain orientation of the hand- 
held device 40 always displays the same portion of the 

10 virtual data object on the display device. 

Figures 2a, 2b and 2c represent a more spe- 
cific example of tilting the hand-held device 40. It 
can be said that a typical starting situation is that 
the hand-held device 40 is in a 20-30 degree angle 

15 with the horizontal plane 8. This plane is in one em- 
bodiment set as a default xy-plane from which the ro- 
tation angles of the hand-held device 40 are measured. 
It can also be said that this starting point is the 
most appropriate one for viewing information with the 

20 display device. So when the user tilts the hand-held 
device 40, the viewing angle changes. The view on the 
display device changes in real time to correspond to 
the new viewing angle. A very important feature of the 
invention is that the view on the display device de- 

25 pends on the viewing angle, and the same viewing angle 
displays always the same view on the display device. 
This feature is very natural and logical. 

In Figure 2a, angle a corresponds to the 
aforementioned 20-30 degrees. Figure 2a is regarded as 

30 a starting position when the browsing begins. In Fig- 
ure 2b, the hand-held device 40 has been tilted to an 
angle p x , which is smaller than angle a. The view on 
the display device changes based on the tilting move- 
ments essentially in real time, and the movement of 

35 the information on the display device is towards the 
same direction as the hand-held device 40 is tilted. 
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In Figure 2c, the hand-held device 40 is tilted to an 
angle J3 2 , which is bigger than angle a. 

In one embodiment, the angle (a) is a prede- 
termined angle, and it is determined by the manufac- 
5 turer of the hand-held device 40. In the determination 
process it is defined that the display view plane is 
based on axis x_VD and y__VD, which are perpendicular 
to each other. The hand-held device is then set to a 
certain position (a) , and that position is set as a 

10 default xy-plane. In Figures 2a, 2b and 2c, the de- 
fault plane is determined based on angle a. In another 
embodiment, the default plane can be freely determined 
based on any x-axis, y-axis and/or z-axis. 

From that moment on, the hand- he Id device 40 

15 is tilted in respective to this plane. When the de- 
fault xy-plane is fixed, the user of the hand-held de- 
vice is always capable of returning to a certain view 
by tilting the device back to the original orientation 
when the sensors measuring the orientation of the 

20 hand-held device do not cause any restrictions to the 
measured position. In another embodiment, the angle a 
can be readjusted to a desired value. 

Figures 3 and 4 represent an exemplary em- 
bodiment of the setup of a "mirroring system" . It in- 

25 eludes a viewpoint VP, a virtual screen VS and a vir- 
tual display VD. The viewpoint VP represents the loca- 
tion of a viewer of a hand-held device. The VD repre- 
sents the display device of the hand-held device. The 
virtual screen represents the actual information 

3 0 browsed on the display device. 

For simplicity in the following the viewpoint 
VP is defined to be at point [0 0 0]. Furthermore, the 
middle point of the virtual display VD is defined to 
be at P_xyz wherein P_xyz = t P_xyz 1 P_xyz 2 P_xyz 3 ] T , and 

35 the virtual screen VS to be at plane x-Jcuva__ shift . 

The orientation of the virtual display VD is 
defined by tilting angels a x ,a y9 a z indicating rotation 
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angle over each coordinate axe. In Figure 4, the vir- 
tual display VD is a plane and has some size. Each co- 
ordinate in this VD plane is defined using notation 
P=[P_xyz 3 +peili_y P_xyz 3 +peili_z] when the orientation 
5 of the VD is defined to be parallel with the x-plane. 

It must be noted that Figures 3 and 4 repre- 
sent only one embodiment of the possible positions of 
the VS, VP and VD, and the axes used. 

In order to the determine the orientation of 
10 the VD, two orthogonal vectors (in the x-plane) are 
defined as follows: 

i=[o,wr 

M = [0XlJ 



Those vectors present the orthogonal direc- 
15 tion vectors of the VD. Next, the orientation of the 
virtual display VD is defined using the rotation an- 
gles: 



20 



10 0 
0 cos(ar x ) -singer,) 
0 sin(a Jt ) cos(a x ) 

cos^) 0 sin(a^) 

0 1 0 
-sin^) 0 oos(a y ) 

cos(a 2 ) -sin(a r ) 0 
sin(a.) cos(a z ) 0 
0 0 1 



Next the unit normal vector of the VD is cal- 



culated: 
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PT X = R x R y R z L 
PT 2 = R x R y R z M 

PNT = PT X x PT 2 (cross product) 

PNT 
PN= 1 1 



PNT\ 

where PN is the unit normal vector of the VD 
-plane. The PN defines the applicable orientation of 
5 the VD to be used in the projection calculation. 

Next, the "image" on the virtual display VD 
is calculated. Let's assume that there is a vector be- 
ginning from the VP and being reflected via the VD. 
The point where the reflected vector hits on the plane 
10 VS defines the projection of the point on the VS to 
the point on the VD-plane. Hence, if all points on VD 
are processed as described above, the image on the VD 
can be defined. 

The idea of calculation is presented using 
15 vectors in Figure 4. Using the vectors the algorithm 
works as follows : 

1. The points P and VP define a vector A. 

2, The projection proj of the vector A on the 
normal vector PN is calculated. 

20 3. The sum of the vector A and proj*PN de- 

fines a point Q. 

4. The points Q and VP define a vector B. 

5. The point defined as sum of the VP and 2*B 
defines a point R. 

25 6. The direction vector that goes via P and R 

defines a direction vector that hits the 
plane VS at point S. 
7. The result of this process is that the im- 
age of point P in VD is the image of point 
30 S in VS. 

By repeating phases 1-7 for all points in the 
VD-plane the whole image of the virtual display VD is 
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defined. Using vector calculation the same can be pre- 
sented as follows: 

First the point P is defined: 

5 P = P_xyz + R x R y R.[o peili_y peili^zj 

where P \_xyz is the coordinate of the middle 
point of the VD, peili_y is the y-coordinate on the VD 
plane -coordinate system and peili_z is the z- 
10 coordinate on the VD plane -coordinate system 

Next, the projection on the normal vector is 

defined: 

A = P-VP 

. AmPN 

15 

Hence the point Q can be defined: 
Q = P-proj*PN 

2 0 Further, the point R can be defined (the rea- 

son for the factor 2 is that in mirror the arriving 
and departing light beam have equal angles compared to 
the normal vector of the surface) . 



25 



5 = fi-FP 
R = VP + 2*B 

And finally the direction vector C is defined 
as follows: 



30 C=R-P. 

Because the VS is located at 
plane x = kuva_shift , the vector C hits that plane at the 

point 
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S=k*C+P 

where 

- P x + £wv*z _ shift 



where P } is the x- component of the point P 
and C, is the x- component of the vector C. Note that 

10 in this calculation the VP was defined to the origin 
to simplify the presentation of the algorithm. How- 
ever, in practice the VP can locate freely in the co- 
ordinate space . It must be noted that the image on the 
virtual screen VS is horizontally inversed when the 

15 virtual screen VS is viewed from the viewpoint VP di- 
rection. 

The system of Figure 4 has several charaster- 

istics: 

1 . The view on the display device moves into 
20 the same direction as it is tilted. In one 

embodiment, the movement of the portion of 
the virtual data object displayed on the 
display device is proportional to the 
change amount and/or rate of the rotational 
2 5 movement . 

2 . When the distance between the VP and VD in- 
creases, the same tilting angle causes 
greater movements on the virtual screen VS. 
In other words, the browsing speed of the 
30 information on the display device increases 

as the distance between the VP and VD in- 
creases. In one embodiment, this movement 
factor can be adjusted by the user of the 
hand-held device. 
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3. When rotating the display device, the view 
on the display device remains unchanged in 
relative to the user, 

4 . The view on the display device depends on 
5 the position and orientation of the VS, VP 

and VD. 

5. A certain VS-VP-VD position/orientation 
combination always constitute the same view 
on the display device. 

10 6. When the position of the VD alters, the 

viewing angle between the VP and VD 
changes . 

7 . Zooming can be implemented by changing the 
position of the VS, VP and VD. 
15 8 . Zooming can be implemented by enlarging the 

object on the VS or altering the radius of 
curvature of the mirror (VD) . 
9. If the figure on the VS is in the right way 
when viewed from the VP, the view on the VD 
20 is mirrored (horizontally inversed) . 

The present invention does not have to imple- 
ment all the aforementioned features, but the most ap- 
propriate ones can be chosen. The ideal mirror-like 
functionality means that the information on the dis- 
25 play device changes when: 

a) the location or orientation of the hand- 
held device in proportion to the coordi- 
nates bound to the physical environment 
changes, 

30 b) the location of the user (VP) in propor- 

tion to the coordinates bound to the hand- 
held device changes, 
c) the virtual location of the data (virtual 
screen) displayed on the display device in 

35 proportion to the coordinates bound to the 

physical environment changes. 
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In order to simulate the operation of a mir- 
ror to the user, the information on the display device 
is changed at least either according to a) or b) . If 
only a) or b) is taken into consideration, the opera- 
5 tion of the display is not so mirror-like as if both 
a) and b) were implemented. In one embodiment, the 
display device operates according to all a) , b) and 
c) . 

Figure 5 represents one example of a pre- 

10 f erred hand-held device 40. The hand-held device 40 is 
e.g. a mobile phone. The hand-held device comprises a 
processor 30 and a display device 10 coupled to the 
processor 30. The data memory 60 and the program mem- 
ory 70 are also coupled to the processor 30. The pro- 

15 gram memory 70 contains e.g. the operation system. The 
sizes of the memories, and the processing power of the 
processor 3 0 depend on the device and application 
used. The program memory 6 0 can additionally contain 
different kinds of software applications with which 

20 various tasks can be executed. Application software 
comprise e.g. word processing, graphical and spread- 
sheet software. The software applications and data 
used by theitr are loaded into the data memory 6 0 in or- 
der to be able to use the software. 

25 The display adapter 90 with the processor 30 

controls the display device 10. In order to not to use 
the data memory 60 for storing display- related infor- 
mation the display adapter 90 comprises a data buffer 
in which the information to be displayed on the dis- 

30 play device 10 is stored. 

The hand-held device 4 0 comprises measuring 
means which in a preferred embodiment of the invention 
refer to acceleration sensor (s) 50. With the accelera- 
tion sensor (s) 50 it is possible to measure tilting 

35 movements of the hand-held device 40. The processor 30 
receives the measurement results and interprets them. 
The acceleration sensor (s) 50 can be e.g. piezo- 
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electric or capacitive producing an analog voltage 
which is proportional to the acceleration factor. 

With the acceleration sensor (s) 50 it is pos- 
sible to measure one, two or three-dimensional accel- 
5 erations. The measurement of tilting movements is 
based on the fact that the highest acceleration is 
parallel to the gravity of the earth. Therefore, the 
orientation of the hand-held device 40 can be defined 
in relation to the earth. It is also possible to use 

10 gyroscopes with its various forms to measure the ori- 
entation of the hand-held device 40. The quantities 
measured are e.g. tilting angle and accelerations. 

The relation information between the rotation 
degree of the hand-held device and the memory address 

15 corresponding to the displayed view is stored e.g. on 
the data memory 60. The processor 30 defines the ori- 
entation of the hand-held device 4 0 in relation to the 
user or a reference position. The processor 30 may 
also define the distance between the user and the 

20 hand-held device 4 0 or the user orientation in rela- 
tion to the hand-held device 40. 

The most important point is not the way of 
how the aforementioned definitions are made but the 
fact that the orientation of the hand-held device 4 0 

25 affects the information displayed on the display de- 
vice 10. The memory space can be implemented logi- 
cally, e.g. as a two-dimensional memory space. When 
browsing starts, the processor 30 starts the defini- 
tion process of the new memory address from the cur- 

30 rent memory address so that displacement in the memory 
space corresponds to the direction and amount of 
change in orientation according to the relation infor- 
mation. 

The hand-held device 4 0 comprises also a 
35 browse lock 80 with which it is signalled when the 
browsing is executed. The orientation of the hand-held 
device 40 must remain in the same position in order to 
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keep the view on the display device unchanged. In a 
preferred embodiment, the hand-held device 40 com- 
prises a lock feature, e.g. a push-button, with which 
the browsing can be locked. The user can tilt the 
5 hand-held device back to an appropriate viewing orien- 
tation in order to view the information on the display- 
device 10 properly. The browsing may then continue 
when the button is released. 

The hand-held device 4 0 in Figure 6 is almost 

10 the same as the hand-held device 40 in Figure 5. In 
Figure 5, the hand-held device comprises also a loca- 
tor 20. It is possible to control the view on the dis- 
play device 10 also by other means than acceleration 
sensor (s) or equivalent means. The hand-held device 40 

15 can comprise e.g. a (video) camera measuring the ori- 
entation and location of the hand-held device in rela- 
tion to the user of the hand-held device 4 0 or to an- 
other reference point in the surroundings of the user. 
The camera 20 may be set to recognise and measure dis- 

2 0 tance to a certain reference point, e.g. the eyes of 

the user. Therefore, when the orientation and/or posi- 
tion of the hand- held device 40 changes, the viewing 
angle measured by the camera also changes. Thus, it 
can be concluded that the hand-held device 4 0 has been 
25 tilted and/or moved towards some direction. 

By analysing the video image it is possible 
to define the orientation of the hand-held device 40 
in proportion to the reference point and the distance 
of the hand-held device 4 0 to the reference point tens 

3 0 of times within a second. The browsing functionality 

can be implemented merely using the video camera, so 
that additional acceleration sensor (s) are not neces- 
sarily needed. The measuring of the distance can also 
be implemented with an ultrasonic radar connected 
35 through an analog- digital converter to the processor 
30 of the hand-held device 40. In one embodiment, from 
the user's perspective the information on the display 
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device 10 is essentially browsed in the same manner as 
when looking in a mirror. In other words, the view on 
the display 10 depends on the viewing angle in rela- 
tion to the display device plane as the view in a mir- 
5 ror depends on the viewing angle to the mirror. 

In one embodiment of Figure 5, the locator 2 0 
comprises a video camera seeking the location of the 
head and eyes of the user. Heuristic algorithms and 
neural network seeking the location of the head and 

10 eyes can be used. Acceleration sensors are more appro- 
priate to use in hand-held devices than a video cam- 
era, because they are cheaper. The acceleration sen- 
sors may also be a more appropriate solution in de- 
vices which do not have a built-in video camera for a 

15 default feature, e.g. in the (third generation) mobile 
phones. The advantage of the use of the video camera 
is that the use of the hand-held device is not re- 
stricted to the position of the hand-held device, e.g. 
when being on one's back the hand-held device can be 

20 used without problems. Also the selection of starting 
point of browsing is more free, and choice (of the 
starting point) can be given to the user of the hand- 
held device. In one embodiment of Figure 5, the display 
device surface level is set as an xy-plane . A certain 

25 relation between the x- axial and/or y- axial movement 
of the hand-held device and the amount of the dis- 
placement of the portion of the virtual data object 
displayed on the display device at a time has been de- 
termined. So, when the hand-held device 40 is moved 

3 0 along x- and/or y-axis, the portion of the virtual 
data object displayed on the display device moves in 
the same direction as the hand-held device is moved in 
the xy-plane according to the relation information. 

In a preferred embodiment of Figures 5 and 6 

35 the processor 30 comprises also means for filtering 
the x-axial, y-axial and/or tilting movements before 
displaying the movements on the display device. There- 
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fore, minor unintentional movements can be filtered 
out . 

In one embodiment of Figures 5 and 6, the re- 
lation between the tilting movements and the amount of 
5 the displacement of the portion of the virtual data 
object displayed on the display device at a time can 
be changed. Therefore, a user may define e.g. that 
from now on a 10 degree tilting causes the same effect 
on the display as a 15 degree tilting earlier. In one 

10 embodiment, the relation is linear. In other words, 
the relation between the tilting movements and the 
amount of the displacement of the portion of the vir- 
tual data object displayed on the display device at a 
time does not depend on the amount of the tilting. In 

15 another embodiment, the relation is linear, but e.g. 
exponential. In other words, the amount of the dis- 
placement of the portion of the virtual data object 
displayed on the display device at a time depends on 
the amount of the tilting. For example, the value of 

20 the relation factor changes (e.g. exponentially) as 
the tilting amount increases. 

Figures 7a - 7d represent the situation where 
the size of the information on the display device de- 
pends on the zoom factor in addition to the orienta- 

25 tion of the hand-held device. The zoom factor can be 
controlled in different ways. In one embodiment, the 
zoom factor depends on the distance between the user 
and the hand-held device. Figure 7a represent the dis- 
play device 10, on which graphical figures 21, 22 and 

3 0 23 are seen. The view on the display device 10 depends 
on the orientation of the hand-held device or the 
viewing angle from which the user of the hand-held 
views the display device. When the user of the hand- 
held device sets figure 21 in the middle of the dis- 

35 play device, and the zoom factor is increased, figure 
21 grows as depicted in Figures 7b and 7c. In Figure 
7d, the zoom factor has decreased, and also the view- 



BNSDOCtO <WO 02003331 A 1 I . > 



WO 02/093331 



PCT7FI02/00095 



ing angle between the user and the hand-held device 
has changed. 

The zoom factor can be modified with several 
different ways. In one embodiment, the zoom factor de- 
5 pends on the distance between the reference point 
(e.g. the eyes of the user) and the hand-held device. 
When the distance decreases, figure 21 grows, and vice 
versa. The display device 10 may have to be set to a 
zoom mode before the zoom factor changes. If the zoom 

10 factor was all the time dependent on the distance be- 
tween the reference point and the hand-held device, 
the browsing operation would not necessarily be prac- 
tical because the view on the display 10 would change 
whenever the aforementioned distance changes. 

15 In another embodiment, the zoom factor 

changes when rotating the hand-held device around the 
axis being essentially perpendicular to a predefined 
xy-plane. The xy-plane may be the present plane of the 
display device 10 or some other predetermined plane. 

20 Yet in another embodiment , the zoom factor is changed 
by tilting the hand-held device. Before this the dis- 
play device must be set into a zoom mode. When the 
hand-held device is tilted, e.g. to the right the zoom 
factor increases, and when the hand-held device is 

25 tilted to the left, the zoom factor decreases. It is 
not important which predefined tilting directions are 
used but that the two directions can be separated suf- 
ficiently from each other. The aforementioned zoom 
mode is set on and off e.g. with a predetermined but- 

30 ton of the hand-held device. 

Figures 8a - 8c represent different ways to 
implement the user interface. In Figure 8a, the dis- 
play device 10 of the hand-held device 40 contains in- 
formation to be viewed by the user. In Figure 8a, an A 

35 letter is on the display device 10, In one embodiment, 
the information on the display device 10 remains in 
the same position with respect to the urer when the 
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hand -he Id device 4 0 is rotated around the axis being 
perpendicular to the display surface plane, as de- 
picted in Figure 8b. In other words, the information 
on the display device 10 remains in the same position 
5 because the information is attached to the real physi- 
cal coordinates . 

In another embodiment, the information on the 
display device 10 remains in the same position with 
respect to the hand-held device 4 0 when the hand-held 

10 device 4 0 is rotated around the axis being perpendicu- 
lar to the display surface plane, as depicted in Fig- 
ure 8c. In other words, the orientation of the infor- 
mation on the display device 10 changes with respect 
to the user of the hand-held device 4 0 because the in- 

15 formation is not attached to the real physical coordi- 
nates but to the display device. 

Figure 9 represents a flow diagram describing 
the functionality of a method of the present inven- 
tion. Figure 9 describes a hand- held device 4 0 com- 

20 prising means for measuring acceleration 50 and a 
processor 30. Means for measuring acceleration refer 
e.g. to a multiaxial acceleration sensor suited for 
measuring changes in the orientation of the hand-held 
device 40. 

25 The hand-held device is switched on, and it 

is ready for browsing information on the display de- 
vice, as represented in phase 100. When the hand-held 
device is functional, the acceleration sensor 50 meas- 
ures constantly acceleration readings. The processor 

3 0 3 0 receives the acceleration readings and defines the 
orientation of the hand-held device and also the 
change in the orientation compared to the prior meas- 
urement (s), as represented in phases 101 and 102. In 
phase 103, it is tested whether the browsing is on or 

35 off. If the browsing is off, the processor 30 examines 
if a predetermined browsing startup condition is ful- 
filled (phase 104) . If it is not fulfilled, the method 
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returns back to phase 101. It means that the orienta- 
tion of the hand-held device has not changed suffi- 
ciently, which would indicate that the user wishes to 
browse information on the display device of the hand- 
5 held device. 

If the predetermined browsing startup condi- 
tion is fulfilled, the processor 3 0 sets the browsing 
as started (phase 106) and determines the browsing 
speed based on the current acceleration value (phase 

10 108) . The processor 3 0 also changes the information 
presented on the display device according to a rela- 
tion between the rotation degree and the amount of the 
displacement of the portion on the virtual data object 
stored on the data memory 60 and the determined brows - 

15 ing speed (phase 108) . A certain orientation of the 
hand-held device always causes the same view (the same 
portion on the virtual data object stored on the mem- 
ory) on the display device. If it is observed in phase 
103 that the browsing is already on, and the browsing 

20 stopping condition is fulfilled (phase 105) , the proc- 
essor 3 0 stops the browsing and sets the browsing as 
stopped (phases 107 and 109) . If it is observed that 
the browsing stopping condition is not fulfilled 
(phase 105) , the processor 30 returns back to phase 

25 101. 

It is obvious to a person skilled in the art 
that with the advancement of technology, the basic 
idea of the invention may be implemented in various 
ways. The invention and its embodiments are thus not 
30 limited to the examples described above, instead they 
may vary within the scope of the claims . 
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CLAIMS 

1- A method for browsing information on a 
display device of a hand-held device, wherein the 
method comprises a virtual display being the display 
5 device of the hand-held device, a viewpoint from which 
the virtual display is viewed and a virtual data ob- 
ject comprising information to be viewed on the vir- 
tual display, wherein the method comprises the steps 
of: 

10 coupling the display device to a digital proces- 

sor; 

mapping information content generated by the digi- 
tal processor into the virtual data object suitable 
for conveying information to the user of the hand-held 
15 device; 

displaying a portion of the virtual data object at 
a time on the display device, the virtual data object 
comprising characters, pictures, lines, links, video 
or pixels that can be conveniently displayed on the 
2 0 display device at a time; 

characterised in that information is 
browsed on the display device essentially in a mirror- 
like way, the method further comprising the step of; 

moving the portion of the virtual data object dis- 
25 played on the display device in the same direction as 
the hand-held device is tilted, whereby a certain ori- 
entation of the hand-held device always displays the 
same portion of the virtual data object on the display 
device . 

30 2. The method according to claim 1, char- 

acterised in that the method comprises the 
steps of ; 

setting a predefined xy-plane as a xy-plane; 
determining a relation between the rotation degree 
35 around the x-axis and the y-axis and the amount of the 
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displacement of the portion on the virtual data object 
displayed on the display device at a time; 

displacing the position of the displayed portion 
of the virtual data object to the right when the hand- 
5 held device is rotated essentially towards the posi- 
tive rotation direction around the y-axis; 

displacing the position of the displayed portion 
of the virtual data object to the left when the hand- 
held device is rotated essentially towards the nega- 
10 tive rotation direction around the y-axis; 

displacing the position of the displayed portion 
of the virtual data object upwards when the hand-held 
device is rotated essentially towards the positive ro- 
tation direction around the x-axis ; 
15 displacing the position of the displayed portion 

of the virtual data object downwards when the hand- 
held device is rotated essentially towards the nega- 
tive rotation direction around the x-axis; and 

displaying the movement of the portion of the vir- 
20 tual data object on the display device of the hand- 
held device according to the set relation. 

3. The method according to claim 2, char- 
acterised in that the method comprises the step 
of: 

25 changing the relation between the rotation degree 

around the x-axis and/or the y-axis and the amount of 
the displacement of the portion on the virtual data 
object in proportion to the distance between the view- 
point and the display device. 

30 4. The method according to claim 1, char- 

acterised in that the movement of the portion 
of the virtual data object displayed on the display 
device is proportional to the change amount and/or 
rate of the rotational movement around the x-axis 

35 and/or y-axis. 
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5 . The method according to claim 1 , char- 
acterised in that the method comprises the 
steps of : 

setting the display device into a zoom mode; 
5 determining the distance between the viewpoint and 

the display device; and 

zooming in or out the displayed information based 
on the determined distance information. 

6. The method according to claim 1, char- 
10 acterised in that the method comprises the 

steps of: 

setting the display device into a zoom mode; and 
zooming in or out the displayed information when 
rotating the hand-held device around the axis being 
15 essentially perpendicular to the predefined xy-plane. 

7. The method according to claim 1, char- 
acterised in that the method comprises the 
steps of : 

setting the display device into a zoom mode; and 

2 0 zooming in or out the displayed information when 

the hand-held device is tilted. 

8. The method according to claim 1, char- 
acterised in that the information displayed on 
the display device essentially depends on the location 

25 and orientation of the virtual display, the viewpoint 
and the virtual data object. 

9. The method according to claim 1, char- 
acterised in that the method comprises the 
steps of : 

3 0 setting the display device surface level as an xy- 

plane ; 

determining a relation between the x-axial and/or 
y- axial movement of the hand-held device and the 
amount of the displacement of the portion of the vir- 
35 tual data object displayed on the display device at a 
time; and 
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moving the portion of the virtual data object dis- 
played on the display device in the same direction as 
the hand-held device is moved in the xy-plane accord- 
ing to the relation information. 
5 10. The method according to claim 1, char- 

acterised in that filtering the x-axial, y- 
axial and/or tilting movements before displaying the 
movements on the display device. 

11. The method according to claim 1, char- 
10 acterised in that changing the relation between 
the rotation degree around the x-axis and y-axis and 
the amount of the displacement of the portion of the 
virtual data object displayed on the display device at 
a time. 

15 12. The method according to claim 1, char- 

acterised in that the method comprises the step 
of: 

keeping the orientation of the information dis- 
played on the display device unchanged when rotating 
20 the hand-held device around the axis being essentially 
perpendicular to the surface level of the hand-held 
device . 

13. A hand-held device for browsing informa- 
tion, 

25 wherein the hand-held device comprises a virtual 

display being the display device of the hand-held de- 
vice, the hand-held device comprising: 
a digital processor (30) ; 

a memory (60,70) coupled to the digital processor 
30 (30), the memory (60,70) comprising a virtual data ob- 
ject suitable for conveying information to the user of 
the hand-held device; 

a display device (10) coupled to the digital proc- 
essor (30) ; 

35 characterised in that the hand-held 

device further comprises: 
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means (30) for moving the portion of the virtual 
data object displayed on the display device in the 
same direction as the hand-held device is tilted, 
whereby a certain orientation of the hand-held device 
5 always displays the same portion of the virtual data 
object on the display device. 

14. The hand-held device according to claim 
13, characterised in that the hand-held de- 
vice comprises: 

10 means (30) for setting an xy-plane as a default 

xy-plane; 

relation information (60) based on the rotation 
degree around the x-axis and y-axis and the amount of 
the displacement of the portion of the virtual display 
15 space displayed on the display device at a time; 

means (30) for determining the rotation amount 
around the x-axis and/or y-axis; and 

means (30) for changing the location of the por- 
tion of the virtual data object displayed on the dis- 
20 play device (10) based on the rotational amount around 
the x-axis and/or y-axis and the relation information 
(RED . 

15 . The hand-held device according to claim 
13, characterised in that the hand-held de- 

25 vice comprises means (30) for changing the relation 
information (60) . 

16. The hand-held device according to claim 
13, characterised in that the hand-held de- 
vice comprises : 

30 means (30) for setting the display device into a 

zoom mode; 

means (20,50) for determining the distance between 
the viewpoint and the display device; and 

means (30) for rooming in or out the displayed in- 
35 formation based on the distance information. 

17. The hand-held device according to claim 
13, characterised in that the hand-held de- 
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vice comprises means (30) for zooming in or out the 
displayed information when rotating the hand-held de- 
vice around the axis being essentially perpendicular 
to the predefined xy-plane. 
5 18. The hand-held device according to claim 

13, characterised in that the hand-held de- 
vice comprises: 

means (30) for setting the display device surface 
level as an xy-plane; 
10 relation information (60) between the x-axial 

and/or y-axial movement of the hand-held device and 
the amount of the displacement of the portion of the 
virtual data object displayed on the display device at 
a time; 

15 means (30) for determining the amount of displace- 

ment in the xy-plane; and 

means (30) for moving the portion of the virtual 
data object displayed on the display device (10) in 
the same direction as the hand-held device is moved in 

20 the xy-plane according to the relation information 
(60). 

19. The hand-held device according to claim 
13, characterised in that the hand-held de- 
vice comprises means (30) for filtering the x-axial, 

25 y-axial and/or tilting movements before displaying the 
movements on the display device (10) . 

20. The hand-held device according to claim 
13, characterised in that the hand-held de- 
vice comprises means (30) for changing the relation 

30 (60) between the rotation degree around the x-axis and 
y-axis and the amount of the displacement of the por- 
tion of the virtual data object displayed on the dis- 
play device (10) at a time. 

21. The hand-held device according to claim 
35 13, characterised in that the hand-held de- 
vice comprises means (30) for changing the relation 
(60) between the x-axial and/or y-axial movement of 



BNSDOCIO <WO_02093331A1_L> 



WO 02/093331 



PCT/FI02/00095 



28 



the hand-held device and the amount of the displace- 
ment of the portion of the virtual data object dis- 
played on the display device at a time. 

22 . A computer program embodied on a com- 
5 put er- readable medium, wherein the computer program 
executes the program steps recorded in a computer- 
readable medium to perform a method for browsing in- 
formation on a display device of a hand-held device, 
wherein the method comprises a virtual display being 

10 the display device of the hand-held device, a view- 
point from which the virtual display is viewed and a 
virtual data object comprising information to be 
viewed on the virtual display, wherein the method com- 
prises the steps of: 

15 coupling the display device to a digital proces- 

sor; 

mapping information content generated by the digi- 
tal processor into the virtual data object suitable 
for conveying information to the user of the hand-held 
20 device; 

displaying a portion of the virtual data object at 
a time on the display device, the virtual data object 
comprising characters, pictures, lines, links, video 
or pixels that can be conveniently displayed on the 

25 display device at a time; 

characterised in that in the method 
information is browsed on the display device essen- 
tially in a mirror-like way, the method further com- 
prising the step of: 

30 moving the portion of the virtual data object dis- 

played on the display device in the same direction as 
the hand-held device is tilted, whereby a certain ori- 
entation of the hand-held device always displays the 
same portion of the virtual data object on the display 

35 device. 
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23 . The computer program according to claim 
22, characterised in that the computer pro- 
gram executes the steps of : 

setting a predefined xy-plane as a xy-plane; 
5 determining a relation between the rotation degree 

around the x-axis and the y-axis and the amount of the 
displacement of the portion on the virtual data object 
displayed on the display device at a time; 

displacing the position of the displayed portion 
10 of the virtual data object to the right when the hand- 
held device is rotated essentially towards the posi- 
tive rotation direction around the y-axis; 

displacing the position of the displayed portion 
of the virtual data object to the left when the hand- 
15 held device is rotated essentially towards the nega- 
tive rotation direction around the y-axis ; 

displacing the position of the displayed portion 
of the virtual data object upwards when the hand- he Id 
device is rotated essentially towards the positive ro- 
20 tation direction around the x-axis ; 

displacing the position of the displayed portion 
of the virtual data object downwards when the hand- 
held device is rotated essentially towards the nega- 
tive rotation direction around the x-axis ; and 
25 displaying the movement of the portion of the vir- 

tual data object on the display device of the hand- 
held device according to the set relation. 

24 . The computer program according to claim 
22, characterised in that the computer pro- 

30 gram executes the step of: 

changing the relation between the rotation degree 
around the x-axis and/or the y-axis and the amount of 
the displacement of the portion on the virtual data 
object in proportion to the distance between the view- 

35 point and the display device. 

25. The computer program according to claim 
22, characterised in that the movement of 
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the portion of the virtual data object displayed on 
the display device is proportional to the change 
amount and/or rate of the rotational movement around 
the x-axis and/or y-axis. 
5 26. The computer program according to claim 

22, characterised in that the computer pro- 
gram executes the steps of: 

setting the display device into a zoom mode; 

determining the distance between the user of the 
10 hand-held device to the display device; and 

zooming in or out the displayed information based 
on the determined distance information. 

27. The computer program according to claim 
22, characterised in that the computer pro- 

15 gram executes the steps of : 

setting the display device into a zoom mode; and 
zooming in or out the displayed information when 
rotating the hand-held device around the axis being 
essentially perpendicular to the surface level of the 
20 hand-held device. 

28. The computer program according to claim 
22, characterised in the computer program 
executes the steps of : 

setting the display device into a zoom mode; and 
25 zooming in or out the displayed information when 

the hand-held device is tilted. 

29. The computer program according to claim 
22, characterised in that the information 
displayed on the display device essentially depends on 

3 0 the location and orientation of the virtual display, 
the viewpoint and the virtual data object. 

30. The computer program according to claim 
22, characterised in that the computer pro- 
gram executes the steps of : 

35 setting the display device surface level as an xy- 

plane; 
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determining a relation between the x-axial and/or 
y-axial movement of the hand-held device and the 
amount of the displacement of the portion of the vir- 
tual data object displayed on the display device at a 
5 time; and 

moving the portion of the virtual data object dis- 
played on the display device in the same direction as 
the hand-held device is moved in the xy-plane accord- 
ing to the relation information. 

10 31. The computer program according to claim 

22, characterised in that filtering the x- 
axial, y-axial and/or tilting movements before dis- 
playing the movements on the display device. 

32. The computer program according to claim 

15 22, characterised in that changing the rela- 
tion between the rotation degree around the x-axis and 
y-axis and the amount of the displacement of the por- 
tion of the virtual data object displayed on the dis- 
play device at a time. 

20 33. The computer program according to claim 

22, characterised in that the computer pro- 
gram executes the step of : 

keeping the orientation of the information dis- 
played on the display device unchanged when rotating 

25 the hand-held device around the axis being essentially 
perpendicular to the surface level of the hand-held 
device . 
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